One Wide Feedforward is All You Need

The Transformer architecture has two main non-embedding components: Attention and the Feed Forward Network (FFN). Attention captures interdependencies between words regardless of their position, while the FFN non-linearly transforms each input token independently. In this work we explore the role of the FFN, and find that despite taking up a significant fraction of the model's parameters, it is highly redundant. Concretely, we are able to substantially reduce the number of parameters with only a modest drop in accuracy by removing the FFN on the decoder layers and sharing a single FFN across the encoder. Finally we scale this architecture back to its original size by increasing the hidden dimension of the shared FFN, achieving substantial gains in both accuracy and latency with respect to the original Transformer Big

Project management in the development of dynamic capabilities for an open innovation era

The aim of the research is to explain how Project Management (PM) ensures the accumulation, integration, utilization, and reconfiguration of the capabilities and knowledge acquired in projects in order to build dynamic capabilities (DCs). This study also gives insight into how PM can develop DCs through the identification and implementation of project management opportunities. The result of 22 semi-structured interviews with 22 participants from 9 companies of different industries are detailed and framed within theoretical dimensions of DCs: knowledge accumulation, integration, utilization, reconfiguration, sensing, and seizing. As a result, we present the best practices, techniques, and PM tools that allow leveraging DCs in organizations. This qualitative study contributes to a theoretical and empirical discussion about how PM transforms knowledge acquired in projects into routines and learning practices that allow organizations to develop or reshape capabilities.info:eu-repo/semantics/publishedVersio

Métodos dos momentos

Os métodos utilizados na resolução de problemas, nos vários ramos da Engenharia ou ciências aplicadas, baseiam-se, actualmente, em uma de duas categorias: métodos analíticos e métodos numéricos. É preferível a utilização dos métodos analíticos, na resolução de equações ou outros modelos matemáticos, sempre que possível, uma vez que formamões gerais em vez de particularizadas, para além de uma maior informação

0-dimensional persistent homology analysis implementation in resource-scarce embedded systems

Persistent Homology (PH) analysis is a powerful tool for understanding many relevant topological features from a given dataset. PH allows finding clusters, noise, and relevant connections in the dataset. Therefore, it can provide a better view of the problem and a way of perceiving if a given dataset is equal to another, if a given sample is relevant, and how the samples occupy the feature space. However, PH involves reducing the problem to its simplicial complex space, which is computationally expensive and implementing PH in such Resource-Scarce Embedded Systems (RSES) is an essential add-on for them. However, due to its complexity, implementing PH in such tiny devices is considerably complicated due to the lack of memory and processing power. The following paper shows the implementation of 0-Dimensional Persistent Homology Analysis in a set of well-known RSES, using a technique that reduces the memory footprint and processing power needs of the 0-Dimensional PH algorithm. The results are positive and show that RSES can be equipped with this real-time data analysis tool.This work has been supported by FCT-Fundacao para a Ciencia e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020

How to build pride in the workplace?

Organizational pride has been proved to benefit organizations by enhancing commitment and reducing turnover cost, encouraging employees to go a step further and consequently increase production and improve performance. Despite the fact that its effects on organizations have been studied, it is still not clear how can organizational pride be created. The aim of this research is to identify the drivers of organizational pride and define strategies that help organizations develop it. Its main contribution is that it performs a comprehensive study on the causes of organizational pride, not focusing only on one or two contributors and not considering organizational pride as an intermediary but as a goal. Using a partial least square path model it was possible to conclude that organizations need to make employees feel appreciated by involving them in the decision making process, and promote the organization’s values so employees can relate to them and maintain honest communications to enhance management credibility.info:eu-repo/semantics/publishedVersio

Synthesis and reactivity of 2-halo-2H-azirines towards nucleophiles

Nucleophilic substitution reactions of 2-halo-2H-azirine with potassium phthalimide and aniline allowed the preparation of new substituted 2H-azirines. The reactions of 2-bromo-3-phenyl-2H-azirine-2-carboxylate with methylamine led to the synthesis of [alpha]-diimines and from the reaction with water, a 3-oxazoline was obtained.http://www.sciencedirect.com/science/article/B6THS-4152YMR-K/1/e94005b66b66b6820ad27458f2562ed